robots.txt
If u change (User-agent: Slurp <
Disallow: /) to (User-agent:
Slurp < Disallow: ) it means that
u want Slurp to have access to
ur site. Slurp in the code is a
robot (bad one I suppose, I
advice u dont give it access).
(User-agent: *) means all
robots, there by granting
access to ur site to all robots
(both good bots like Google
and bad robots like Slurp). Bad
robots can hack ur site or spy
on it and send info to a hacker
(the robot owner/sender). Pls
note that < represents line
break code as u see when
editing ur robots.txt file
BACK
HOME